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ABSTBICT 

& study to deteraine the relationship of a teacher's 
characteristics and experience to a learner* s cognitive attainaent. of 
lav-relatad content is discussed. Over 1#000 learners and 57 teachers 
who had participated in a Lav in z Changing Society 9orlcshop provided 
data for the study. The workshop provided participants vith 
law-related aaterials and instructional techniques for standard 
social studies curricula at various grade levels, classrooa sets of 
data covered five sublect areas; fifth grade Oaited States History, 
seventh grade Texas Studies, eighth grade Aaerican History X, ninth 
through 11th grade JUierican History II, and 12th qrade Civics. 
Control groups were coaprised of classes with teachers who neither 
attended the workshop nor received law-focused aaterials. Instrt*nents 
for both teachers and students contained affective and cognitive 
iteas. Besults indicate that differences aaong teachers regarding 
content knowledge, instructional skills, and teaching experience 
result in cognitive attainaent differences aaong classes of learners. 
Bowever* the effect of the individual teacher is acre pronounced in 
the upper grades. (KC) 
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Precepts from teacher effectiveness research and educational policy 
research were combined in this investigation to produce three conceptual 
models of teacher effectiveness. These models were used as a basis for 
determining the influence of teachers on learner attainment of law related 
content. Regression solutions for these three models were performed for 
five suDsamples and for the total sample of 1,111 learners and 57 teachers. 
Comparisons of the solutions to the various regression models yielded 
results which indicate thit characteristics of teachers do exert substantial 
classroom influence on the cognitive attainment of law related content by 
learners. 
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Teachers and instructional design specialists are confident that 
knowledge, understanding and attitude toward the law are enhanced if 
learners identify with legal issues through simulations, case studies, and 
first-hand observations of the legal system. To this end, a variety of 
instructional techniques, namely, critical incident, police ride-along, 
mock trial, case study, have been developed and sequenced into instructional 
strategies to teach the various components of a law focused curriculum. 
While the literature on law-focused education is expanding rapidly, little 
empirical documentation has appeared to confirm the value of various law 
related curricula and the effectiveness of teachers in implementing these 
curricula. Our efforts have been directed primarily to the influence of the 
teacher in implementing a curriculum, assuming the law-related content and 
instructional strategies designed for the curriculum are sound. 

Theoretical Considerations 

The Equality of Educational Opportunity Survey, commonly knov/n 
as the Coleman Report (Coleman, Campbell, Hobson, McPartland, E^ood, Weinfield, 
York, 1966), has had a marked impact on education. For example, the report 
indicated that variables contributing most to the variance in learner achieve- 
ment in descending order were: home environment, student body characteristics, 
teacher characteristics, and finally school facilities and curriculum. To 
be sure, these findings produced a maelstorm of controversy regarding tho 
limited significance of the formal educational enterprise on learner achiovcninnt 
and other forms of student outcanes typically associated with the public schools. 
Yet, the report did stimulate thought and public arousal that focused directly 
on the effectiveness of teachers, curriculum, and schools in fostering learning. 
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Within the research cotnmunity, subsequent analyses of the Colcnian 
Report data provided additional interestifig findings, such as, teacher experience 
positively influences student cchievement and the race of the teacher influ- 
ences cognitive verbal achievement (Hanusehek, 1972). An equally Important 
consequence of these secondary analyses was the development of conceptual 
models for documenting the educational process. Typically, these model 
building efforts were constructed to explain an individual's educational 
achievement in terms of the following factors: individual and fa" ily charac- 
teristics, peer group influences, genetic endowment, school resources, study 
attitudes (Barro, 1970; Hanusehek, 1972). 

Sampling designs, constructed to provide empirical data for testing the 
accuracy of these model building efforts, were, in most instances, initially 
structured to yield results that centered almost exclusively on district 
level parameters for learning outcomes. Hence, these designs and their 
corresponding data collection strategies did not specifically address 
teacher and learner behaviors in individual classrooms. 

A second difficulty encountered in early attempts to demonstrate the 
value of these conceptual models was the selection of an appropriate statis- 
tical model for data analysis, Multiple regression techniques, which were 
employed in similar model building efforts in agriculture, economics and 
engineering, often produced biased and inconsistent estimates when applied 
to empirical data from the schools. The primary reason for inaccurate 
estimates was determined to be the high interrelationships among educational 
process variables, which is known as the multicoll inearity prob'^r-m in statis- 
tical analysis. 

In recent studies, considerable progress has been made to eliminate 
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research dosiyn problems encountLTod in jMrlior dr^vnloiHiiinil.i 1 pffortn. ffif 
estimation problem was resolved by specifying the oducationcil process vorioblrs 
as a system of simultaneous equations that would lead to more accurate para- 
meter estimates for the already known high correlations among independent 
process variables (Sewell, Mauser and Featherman, 1976; Cooley and Lohnes, 
1976). Murnane (1975), McDonald (1977) and McNamara (1977) have also 
'significantly extended sampling designs and their corresponding data requirements 
to model explicitly intraschool and interclass variables. Hence, they provide 
a more direct measure of the influence of the teachers and the curriculum 
on the achievement of learners. However, the specification of classroom 
instructional events in this area of research continues to be more of a goal 
than a reality. 

Ironically, a complementary body of educational research generally termed, 
teacher effectiveness, has concentrated on the development and refinement of 
process and product variables associated with classroom instruction. Extensive 
reviews of research on teacher effectiveness have compiled the various results 
of classroom observation investigations into lists of factors, such as, learner 
time on task, businesslike manner of teacher, and teacher enthusiasm, whicii 
positively influence learner achievement (Brophy, Good, 1974; Brophy, Evertscn, 
1975; Medley, 1977; Rosenshine, 1977; Rosenshine, Furst, 1971). Unfortunately, 
investigations on teacher effectiveness have seldom been based on an overall 
mathesnatical model or framework to guide the selection of teacher »ind lenrnnr 
behaviors to be measured. Moreover, few investigations have provided a rationale 
for the kinds of teacher behavior they assessed, and oven fewer demonstrated an 
Interest in the causal sequences of behavior that were possible prerequisites 
to the single variable they did measure (Borich and Fenton, 1977). 
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This investigation has atlcmptrd f.n coml inp n\n ',| n'Ofil.h'i of Uu> 
aforementioned lines of research (conceptual models and specific tnachor 
variables). To this end, the following primary hypothesis has been dovelopc 

1. The effect of a single academic course on a learner's cognitive 
attainment of law related content depends on the classroom 'o 
which a learner is assigned. 

If significant differences do exist among classrooms, then attempts 

to identify teacher related variables that are good predictors of learner 

cognitive growth are in order. Accordingly, the secondary hypothesis takes 

the following form. 

2. The effect of a single academic course on a learner's cognitive 
attainment of law related content depends on the teacher's 
characteristics and experience within a given classroom to 
which the learner is assigned. 

Research Design 

Setting. A series of law-focused education workshops were conducted at 
several locations over the state of Texas during the past three years. 
While informal evaluations of the initial workshops were very favorable, 
sponsors of the workshops (Criminal Justice Division, Offic? of the 
Governor; and the Texas State Bar Association) encouraged the development 
and implementation of a formal evaluation plan. This plan included the 
collection of cognitive achievement and attitudinal data from workshop 
participants and the subsequent collection of cognitive and attitudinal 
data from their pupils during the ensuing school year. Such a plan v/as 
developed and implemented, resulting in the formation of a substantial 
data base from teachers and their students on law related concepts and 
principles. 

Scmple, A total of 1,111 learners and 57 teachers provided data 
for this investigation. Teachers who had participated in a Law in a 
Changing Society Workshop and one of their classes were selected 
randomly from the total workshop enrollment to participate in the 
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suDsequent evaluation. The workshops provided parLir. ip.ints with Inw 
related materials and instructional techniques for stdridard social stu'lii-s 
curricula at various grade levels. Two concomitant teachers and their 
classes were identified for each workshop participant, one as a "partner" 
teacher with whom the participant shared ideas and materials and another 
teacher and class who served as a control. The control teacher did not 
attend the workshop nor was s/he provided access to law-focused curricular 
materials. These procedures resulted in complete classroom sets of data 
from social studies teachers across five subject areas, i.e.. Fifth 
grade-U.S. History (25 teachers, 485 learners). Seventh grade-Texas Studies 
(6 teachers, 124 learners). Eighth grade American History I (8 teachers, 
143 learners). Ninth-eleventh grade-American History II (10 teachers, 195 
learners), and Twelfth grade-Civics (8 teachers, 164 learners). 

""eacker Measures. Two instruments were developed to obtain cognitive 
and attitudinal data from teachers on law related concepts and principles. 
One of these measures was designed for elementary and middle school teachers 
(grades 5-8), while the second test was developed for senior high teachers 
(grades 9-12). Both instruments contained 20 identical attitude items and 
25 multiple choice cognitive itans which were different for each instrument. 
Estimates of internal consistency were determined to range from .73 to .87 
for the cognitive components of these instruments with the Kuder Richardson- 
20 procedure. Further, each instrument was reviewed for content validity 
with respect to law-related concepts by a panel of university professors 
and the law focused workshop staff. Additional data from each teacher 
(experience, workshop participation, school assignment) were obtained from 
biographic sheets attached to each of the aforementioned tests. 
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Leavm:r Mcanurca. Five instruments were developed to obtain cognitive 
and attitudinal data from pupils of teachers participating in the law- 
focused education project. The instruments were developed for che dif- 
ferent grade levels, that is, 5th, 7th, 8th. 9-llth, 12th. Each of the 
tests contained a cognitive component consisting of 20 multiple-choice 
Items and an attitude component containing 20 items. The cognitive items 
of the various tests emphasized law topics related to social studies 
curricula at various gradf; levels, namely, U.S. History (grade 5), 
Texas Studies (grade?), American History I (grade 8), Amerxan History II 
(grade 9 or 11), and Civics (grade 12). The attitude component of each 
instrument contained 10 Likert type items on law-related issues and 10 
items seeking learner perceptions of the classroom practices of the 
teacher. Copies of these instruments are provided elsewhere (Denton, 
Kracht. 1977). 

Each instrument was reviewed by a panel of judges consisting of 
classroom teachers, workshop staff, and university professors to determine 
the instruments' content validity, and readability. Estimates of internal 
consistency for the cognitive component of each instrument were determined 
using the Kuder Richardson-20 formula. These values ranged form .61 to 
.78 with the 5th grade test providing the highest value. 

The development and use of instruments specifically designed to 
measure cognitive attainment of law-related topics is a departure from the 
more common and oft criticized practice of drawing achieve»ncnt datii from 
standardized tests. Construction of these instruments wns necessary 
Since achievement tests that were available simply did not measure the 
concepts and principles espoused in the law-focused education workshops 
and materials. 
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MoflaL licnujn. Our hypotheses rtM),irdimj lonrfH.'r niit.coMcjs rc-.iiUc'd in 
the specification of educational process and individual student variables 
as a system of three linear structural equations. To satisfy estimation 
requirements, each structural equation takes the fonn of a regression 
model. The three multiple linear regression models are presented in 
figure 1. Each model reflects a specific aspect of the set of hypothesized 
relations. 

In model 1, learner cognitive attainment of law related content 
at the end of a course depends on the learners' prior knowledge of and 
attitudes toward law related content. Inherent to this regression model 
is the assumption that the effect of a course is independent of the 
classrOOTi and the teacher to which the learners are assigned. 

Model 2 presents end of course cognitive attainment of law related 
content by learners as a function of the classroom in which the learners 
spent the course as well as their prior knowledge of law related content 
and attitudes held toward that content. Underlying this model is the 
assumption that the effect of an academic course alno depends on the 
classroom to which learners are assigned. 

In model 3, learner cognitive attainment of law related content 
at the end of a course depends on the characteristics and background of 
the teacher to which the learner is assigned as well as the student in- 
fluences specified in model 1. Hence, this model differs from model 1 
in that it assumes additional factors to determine the effect of an 
academic course on learner outcomes are the teachers and their individual 
characteristics. Model 3 also differs from model 2. Specifically, model 
2 captures the total influence of classrooms on learner gain, but does 
not isolate the influence of any individual factors such as teaching 



experience or classroom practices. 

Testing hypothcBes, The primary and secondary hypotheses are tested 
by comparing the explanatory power (multiple r-squared values) determined 
for each of the three regression models. These comparisons take the 
form of standard F-tests which are described in figure 1. The logic 
underlying each test can be described in terms of the r-squared values 
estimated for each structural equation. 

To test the primary hypothesis we compare models 1 and 2. If the 
observations are consistent with our hypothesis, then the explanatory 
power of model Z should reflect a significant increase over the explanatory 
power of model 1. As noted in figure 1, model 1 does not take into 
account the influence of classroom assignment. 

To test the secondary hypothesis, we compare models 1 and 3. If the 
observations are consistent with the secondary hypothesis, then the ex- 
planatory '^ower of model 3 should exhibit a significant gain over the 
explanatory power of model 1. 

Our sampling plan permits several tests for both hypotheses. Speci- 
fically, the regression models are compared first with respect to each 
grade classification. Hence, our research design not only allows us to 
test if the hypothesized relationships are likely to be consistent over all 
grade levels, but also provide us with empirical evidence to estimate 
more precisely the magnitude of these explanatory differences at ench qrnde 
level. 
Findings 

Prvnary Hypothesia. The F-test results (see Table 1) corresponding 
to the tests of H(P) are all statistically significant beyond the 0.01 
probability level. These empirical results clearly support the position 
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that quality differences do, exist aiiiumj classroom!;. M{)n!i)V{»r, lhor,L' 
contributions are unique in that they do not result If wn attempt to 
predict learner outcomes without knowledge of the classroom to which 
each was assigned. 

Secondary Hypothesis. The secondary hypothesis addressed the issue 
of whether characteristics of the teacher would account for some of the 
differences in cognitive attainment of law related content among middle 
school through senior high school learners. The F-test results for H{S) 
in Table 1 are also all significant beyond the 0.01 probability level. 
These findings are consistent with our hypothesis that teacher character!? I .s 
and experience identify an important contribution to learner outcomes 
that cannot be predicted when we fail to link students with their actual 
assigned teachers. 

classroom Differences. An examination of the structural equations 
provides additional information to describe the estimated magnitudes of 
difference at each grade level. The total unique influence of classroom 
assignment can be obtained by subtracting model 1 results from those 
determined for model 2. These differences appear in Table 1 denoted as the 
letter A. Careful examination of these model differences reveals a trend 
whereby the differences decrease as the grade level increases. These differences 
range from a high estimate of 47.1 percent of the variance at grade five to 
a minimum estimate of 11.8 percent at grade 12. 

Taai'fw.v M.ffni'r>u'.'n. Estimates for the contributions of tnnchcr- 
related variables on learner cognitive attainment can bo obtained for 
each grade level classification by subtracting model 1 results from 
those presented for model three. These differences appear In Table 1 
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denoted by the letter B. In this cnso, the difrcrrru:!.". sufjtjci.t n rol.H.ivoly 
Stable and consistent teacher influence at all grade levels. Those 
estiniates range from a high of 20.8% of the variance in the grade seven 
sample to a minimum of 10.6% of the variance in the grade 12 sample. 

Teacher Influenaes. A comparison of the ratios between teacher and 
classroom explanatory power estimate (C) in table 2 reveal yet another Important 
but frequently overlooked relationship. While the largest total classroom 
estimates are found for the lower grades, the ratio of teacher influence 
to total Influence at each grade level suggests a relationship with the 
largest relative value appearing In the grade 12 sample where it shares 
approximately 90 percent of the total variance associated with classrooms. 
Discussion 

Our findings clearly Indicate that differences do occur among 
social studies classrooms regarding learner cognitive attainment of law 
related content. While there are many reasons why classrooms differ, we 
have assumed teacher influence to be an important source of these differences. 
In particular, teacher characteristics of: workshop participation, 
teaching experience, knowledge of content, and classroom practices were 
examined to determine their collective effect on learner cognitive attainment 
of law related content. 

The supervisory notion of providing inservice programs to modify 
teacher behavior and enhance learner achievement assumes teachers transfer 
knowledges and skills gained from workshops to their classrooms. Further, 
teacher effectiveness research has documented relations do exist between 
various classroom behaviors of teachers and learner achievement (Brophy, 
Good, 1974; Brophy, Everston, 1976; Medley, 1977; Rosenshine, 1977). 
Because of these notions and research findings, participation in a law- 
focused workshop was included in the block of teacher variables. 



Similarly, investigations by Murnano (19/5) and Mctaara (1977), 
found significant relations between teaching experience and learner achiovn- 
ment; and the previously cited literature on teacher effectiveness is replete 
with relations between various teacher process variables and learner 
achievement. Thus, teaching experience and classroom practices have precedents 
1n the literature justifying their inclusion in the block of teacher variables. 
Conversely, the relation between learner achievement and teacher knowledge 
of subject matter has seldom been addressed. Thus, teacher content 
knowledge as a construct in a model for teaching effectivenessmay account 
for unexplained variation in the instructional process. Moreover, inclusion 
of this variable in a theoretical model of teacher effectiveness is 
compatible with re'^ression techniques. 

It is evident these teacher variables do influence learner cognitive 
attainment of law related content. This generalization is based on the 
explanatory power of the teacher variables (B Values in table 1) and, 
the rjtios comparing the explanatory power of these teacher characteristics 
with classroom assignments (C values in table 1). In particular, the 
ratio values indicate the Influence of the teacher contributes substantially, 
across all grade levels, to the differences among classrooms regarding 
learner cognitive attainment. In other words, differences among teachers 
regarding content knowledge, instructional skills, and teaching experience 
do, in fact, result in cognitive attainment differences among classes of 
learners. This generalization which is so logical and self-evident to 
educators, has often eluded those concerned with empirical verification. 
The aforementioned ratios do lend credence, in empirical terms, to the 
Influence of the teacher on learner cognitive attainment. Further, these 
results Indicate the effect of the Individual teacher is more pronounced 
In the upper grades regarding cognitive attainment of course specific content. 

U 
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Ironically, this finding would not be so eviiloni Imd tttu annlysis liiM-ri 
conducted only on the total sample, where only 10 percent of the explanatory 
power is conrnon to teacher characteristics and classroom assignment. For 
this reason, we encourage the disaggregation of data into subsainples by 
grade level when examining the influence of teachers on the cognitive 
attainment of learners. 

Certainly this investigation has not exhausted the potential teacher 
characteristics which could be considered as teacher variables. The teacher's 
age, sex, educational background and race are but a few of the more 
obvious characteristics which could be included in future researches. Given 
these additional teacher variables and attention to grade levels, perhaps 
new insights into theory building for determining teacher effectiveness is 
near at hand. In closing, the results of our investigation do enable us 
to answer the question posed in the title of the paper with an encouraging 
YES , TEACHERS DO MAKE A DIFFERENCE IN. TEACHING LAW RELATED CONTENT . 
Moreover, this difference can be observed at all grade levels where law 
focused education is introduced in the social studies curriculum. 
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Table 1 

Suniiiary of Information For Structural Equations 





COTposite of 
all Grades 


Grade 
5 


Grade 
7 


brade 
8 


brade 
9/11 


uraae 
!2 


ffurrber of learners 


nil 


485 


124 


143 


195 


164 


Nuir.ber of Classrooms 


57 


25 


6 


8 


10 


8 


No. of Teacher Variables 


6 


6 


6 


6 


6 


6 


2 

R from model 1 


.088 


.108 


.283 


.134 


.251 


.136 


2 

R from model 2 


.532 


.579 


.561 


.394 


.409 


.254 


from model 3 


.134 


.274 


.491 


.301 


.369 


.242 


r swalriSuiC LcSLifiy n\r/ 




r \ c*f j*fD/ / 


r ^0, J \/ } 


r \ / f I J*t / 


CfO '\SlA\ 

r \ 9 y i 0*t J 


r V ' « i 30 f 




17.82* 


21.30* 


14.82* 


8.21* 


5.47* 


3.50* 


F statistic testing HIS) 


F(5,n02) 


F(5,475) 


F(5,n5) 


F(5,134) 


F{5.186) 


F(5J55) 




11.71* 


21.76* 


9.40* 


6.40* 


6.96* 


4.34* 


A « ■ ^1 




.471 


.278 


.260 


.158 


.118 


B « R3 - R^ 




.166 


.208 


.167 


.1 18 


.106 


C « B f A 




.352 


.748 


.642 


-747 


.898 



♦-a<.01 
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Model 1: yg ^ b^y^ + bgA^ ^ a < E(t) 

m 

ftodel 2: yg = b^y + bgA^ * ^^^^ 

P 

Model 3: Yg = b^y^ + ^^c'^t^^Vj ^^^^ 

j=l 

^2 = end of course cognitive score of learner on law-related material. 

« beginning of course cognitive score of learner on law-related material 

« beginning of course learner attitudes toward law-related concepts. 

Cj « 1 if the learner was assigned to a classroom j; zero otherwise. 

a = effect of a single academic course on learner achievement. 

b^ = least square weight associated with first two variables. 

Cj = least squares weight associated with each Cj 

T, = 1 if the learner's teacher participated as a "partner" teacher, zero 
otherwise. 

Tg = 1 if learner's teacher participated as a "partner" teacher, zero 
otherwise. 

= 1 if the learner's teacher served as a control teacher, zero otherwise. 

= Teaching exparience of learner's teacher. 

Tg * beginning of course cognitive test score of teacher on law related material. 

Tg = end-of -course learner perceptions of teacher's classro«n practices, 

tj = least squares weight associated with each ly 

m = the number of classroom variables in the model, 

p = the number of teacher variables in the model. 

N = the number of learners in the model. 

E(1) = the error-of-prediction vector for model i. 

R^2 « coefficient of determination for model 1 (proportion of variance accounted 
for by model 1). 



F Tests for Primary and Secondary Hypotheses 

H(P)F « [^2^ " dftl) = (ni+2)-3 

LI - R2^]/df{2) df(2} = N.{m+2)-l 

HIS)F « [Rj^ - R,^3/df(3) df(3} = (p+2)-3 

[1 - R3^]/df(4) df(4) = N-(p+2)-l 

Figure 1 

Regression models and F statistics 
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